際際滷

際際滷Share a Scribd company logo
R顎恢姻庄界壊

           Pam Beard


09/17/12               1
Whats a rubric?
 Analytic rubrics have
     Levels of performance
     Multiple criteria




09/17/12                      2
 "Rubrics" explicitly state criteria for
  assignments.
 May lead to a grade or be part of
  the grading process.
 Are more specific, detailed, and
  disaggregated than a grade.
 Show strengths and weaknesses in
  student work.
09/17/12                                    3
Another definition
 Assess student performance along
  a task-specific set of criteria
 Measures performance against a
  predetermined criteria
 Includes essential criteria for the
  task
 Has multiple levels of performance

09/17/12                                4
Characteristics of Rubrics
 Increase an assessment's construct and
  content validity
 Increase an assessment's reliability
     set criteria that raters can apply consistently
      and objectively
 Established criteria reduces bias
 Can help teachers clarify goals and
  improve their teaching
 Help learners set goals and assume
  responsibility for their learning

09/17/12                                                5
Characteristics Continued
 Help learners develop their ability to
  judge quality in their own and
  others' work
 Provides specific feedback about
  areas of strength and weakness
 Learners can use rubrics to assess
  their own effort and performance
  before submitting it
09/17/12                               6
Characteristics Continued
 Learners and teachers monitor
  progress over a period of instruction
 Reduces time spent grading
 Engaging students in the design
  empowers them
 Moves away from subjective
  grading

09/17/12                                  7
Types of Rubrics
 Ask yourself:
     For a particular task, do you want to
      be able to assess how well the students
      perform on each criterion, or do you
      want to get a more global picture of
      the students' performance on the
      entire task?



09/17/12                                    8
Holistic
 a holistic rubric does not list
  separate levels of performance for
  each criterion

 a holistic rubric assigns a level of
 performance by assessing
 performance across multiple criteria
 as a whole.
09/17/12                               9
Holistic Example
  3 - Excellent Researcher
   included 10-12 sources
   no apparent historical inaccuracies
   can easily tell which sources information was drawn from
   all relevant information is included

  2 - Good Researcher
   included 5-9 sources
   few historical inaccuracies
   can tell with difficulty where information came from
   bibliography contains most relevant information

  1 - Poor Researcher
   included 1-4 sources
   lots of historical inaccuracies
   cannot tell from which source information came
   bibliography contains very little information
09/17/12                                                       10
Analytic Rubric
 http://www.connectingwaters.org/
  Assessment/4ptrub.htm




09/17/12                             11
When to choose an analytic
            rubric

 Want to assess each criterion
  separately
 Involve large number of criteria
 More variance across the criteria
 Need to weight criteria differently


09/17/12                                12
Designing an Analytic Rubric

 Step 1. Re-examine learning objective to be
  addressed by the task.

 Step 2. Identify observable attributes you want to
  see (as well as those you dont want to see) your
  students demonstrate in the product, process, or
  performance.

 Step 3. Brainstorm characteristics of each attribute.


09/17/12                                               13
Design Analytic Continued
 Step 4b. Write thorough narrative
  description for excellent and poor work for
  each individual attribute.
 Step 5b. Complete the rubric by describing
  other levels on the continuum that ranges
  from excellent to poor for each attribute.




09/17/12                                    14
Hint: Use Even Number of
                Levels
 Use an even number (4 or 6) of levels
  of performance on the scale.
 When there are an odd number of
  levels, the middle level tends to
  become a catch-all category.
 With an even number of levels, raters
  have to make a more precise judgment
  about a performance when its quality is
  not at the top or bottom of the scale.
09/17/12                                15
Hint: Arrange Levels Low to
               High
 Low to High scale.
 Students read first the description of
  an exemplary performance in each
  criterion.




09/17/12                               16
Sample High to Lows
       1            2              3              4
Unacceptable    Acceptable     Excellent     Exemplary




Not there yet   Progressing      Meets         Exceeds
                              expectations   expectations



 Needs work        Fair          Good         Superior




09/17/12                                                    17
More Hints
 Limited number of dimensions or criteria.
     The criteria are those components that are
      most important to evaluate in the given task
      and instructional context.
     A rubric with too many dimensions may be
      unworkable in classroom assessment.
 Equal steps along the scale.
     The difference between 4 and 3 should be
      equivalent to the difference between 3 - 2
      and 2 - 1.
     "Yes, and more", "Yes", "Yes, but", and "No"

09/17/12                                             18
 This is one from High to Low




09/17/12                         19
4                  3                     2                    1

 Task              All               Most                  Some            Very few or none

 Frequency       Always             Usually          Some of the time      Rarely or not at
                                                                                 all

 Accuracy       No errors         Few errors            Some errors        Frequent errors

 Comprehen       Always          Almost always         Gist and main       Isolated bits are
 sibility      comprehen        comprehensible           ideas are         comprehensible
                  sible                               comprehensible

 Content          Fully           Adequately               Partially          Minimally
 coverage      developed,         developed,             developed,          developed,
                  fully           adequately         partially supported      minimally
               supported          supported                                  supported
  Vocabulary

    Range        Broad             Adequate               Limited            Very limited

   Variety        Highly      Varied; occasionally     Lacks variety;        Memorized;
               varied; non-        repetitive            repetitive        highly repetitive
                repetitive




09/17/12                                                                                    20
Chocolate Chip Cookies
 Break into pairs.
 Compete the worksheet Creating a Rubric.
 Create a rubric for judging the quality of a
  chocolate chip cookie.
     -Be sure to decide if you want to do a holistic or
      analytic rubric!!!!
     Be prepared to defend your decision.
 Use the handout on Rubric Examples to help
  you when you get stuck!
 When you all finished, you will get to judge
  the cookies using the different rubrics.
09/17/12            See Lesson Builder Page 9 for          21
                             Handouts
Using RubiStar
 These are some simple steps for
  getting started with Rubistar.
 Access the site
  http://rubistar.4teachers.org.
 Take a moment to read about the
  different features.
 When you are ready to get started,
  click on the tutorial and choose the
  option you prefer.
09/17/12                                 22
Rubistar Tips
 If you are using Internet Explorer, you can
  copy the rubric and paste it into a Word
  document where you can continue to edit.
 When first getting started, you might want to
  choose an existing template.
 You may find that you can create a rubric you
  like by combining existing rubrics into one of
  your own.
     You can do this by opening two windows to
      Rubistar and copying and pasting between
      windows.
09/17/12                                          23
Assignment
 Create a rubric for an
  objective/competency you have for a
  class you teach.
 Use the worksheet on creating a rubric
  to get you started.
 Divide into teams.
 Exchange rubrics and use the Aunt
  Olive's Rubric on Rubrics to provide
  feedback to a colleague on their work.
09/17/12       Lesson Builder Page 10      24
Review
1. Describe a rubric (what is it).
2. Describe the purpose of rubrics.
3. Describe the difference between holistic
      and analytic rubrics.
4. List the characteristics of good rubrics.
5. Develop a rubric for judging the quality of a
      product (chocolate chip cookie).
6. Create/modify a rubric for an assignment or
      activity in a class you teach.
7. Identify strengths and weaknesses in a
      rubric.
09/17/12                                         25

More Related Content

Rubric pp

  • 1. R顎恢姻庄界壊 Pam Beard 09/17/12 1
  • 2. Whats a rubric? Analytic rubrics have Levels of performance Multiple criteria 09/17/12 2
  • 3. "Rubrics" explicitly state criteria for assignments. May lead to a grade or be part of the grading process. Are more specific, detailed, and disaggregated than a grade. Show strengths and weaknesses in student work. 09/17/12 3
  • 4. Another definition Assess student performance along a task-specific set of criteria Measures performance against a predetermined criteria Includes essential criteria for the task Has multiple levels of performance 09/17/12 4
  • 5. Characteristics of Rubrics Increase an assessment's construct and content validity Increase an assessment's reliability set criteria that raters can apply consistently and objectively Established criteria reduces bias Can help teachers clarify goals and improve their teaching Help learners set goals and assume responsibility for their learning 09/17/12 5
  • 6. Characteristics Continued Help learners develop their ability to judge quality in their own and others' work Provides specific feedback about areas of strength and weakness Learners can use rubrics to assess their own effort and performance before submitting it 09/17/12 6
  • 7. Characteristics Continued Learners and teachers monitor progress over a period of instruction Reduces time spent grading Engaging students in the design empowers them Moves away from subjective grading 09/17/12 7
  • 8. Types of Rubrics Ask yourself: For a particular task, do you want to be able to assess how well the students perform on each criterion, or do you want to get a more global picture of the students' performance on the entire task? 09/17/12 8
  • 9. Holistic a holistic rubric does not list separate levels of performance for each criterion a holistic rubric assigns a level of performance by assessing performance across multiple criteria as a whole. 09/17/12 9
  • 10. Holistic Example 3 - Excellent Researcher included 10-12 sources no apparent historical inaccuracies can easily tell which sources information was drawn from all relevant information is included 2 - Good Researcher included 5-9 sources few historical inaccuracies can tell with difficulty where information came from bibliography contains most relevant information 1 - Poor Researcher included 1-4 sources lots of historical inaccuracies cannot tell from which source information came bibliography contains very little information 09/17/12 10
  • 11. Analytic Rubric http://www.connectingwaters.org/ Assessment/4ptrub.htm 09/17/12 11
  • 12. When to choose an analytic rubric Want to assess each criterion separately Involve large number of criteria More variance across the criteria Need to weight criteria differently 09/17/12 12
  • 13. Designing an Analytic Rubric Step 1. Re-examine learning objective to be addressed by the task. Step 2. Identify observable attributes you want to see (as well as those you dont want to see) your students demonstrate in the product, process, or performance. Step 3. Brainstorm characteristics of each attribute. 09/17/12 13
  • 14. Design Analytic Continued Step 4b. Write thorough narrative description for excellent and poor work for each individual attribute. Step 5b. Complete the rubric by describing other levels on the continuum that ranges from excellent to poor for each attribute. 09/17/12 14
  • 15. Hint: Use Even Number of Levels Use an even number (4 or 6) of levels of performance on the scale. When there are an odd number of levels, the middle level tends to become a catch-all category. With an even number of levels, raters have to make a more precise judgment about a performance when its quality is not at the top or bottom of the scale. 09/17/12 15
  • 16. Hint: Arrange Levels Low to High Low to High scale. Students read first the description of an exemplary performance in each criterion. 09/17/12 16
  • 17. Sample High to Lows 1 2 3 4 Unacceptable Acceptable Excellent Exemplary Not there yet Progressing Meets Exceeds expectations expectations Needs work Fair Good Superior 09/17/12 17
  • 18. More Hints Limited number of dimensions or criteria. The criteria are those components that are most important to evaluate in the given task and instructional context. A rubric with too many dimensions may be unworkable in classroom assessment. Equal steps along the scale. The difference between 4 and 3 should be equivalent to the difference between 3 - 2 and 2 - 1. "Yes, and more", "Yes", "Yes, but", and "No" 09/17/12 18
  • 19. This is one from High to Low 09/17/12 19
  • 20. 4 3 2 1 Task All Most Some Very few or none Frequency Always Usually Some of the time Rarely or not at all Accuracy No errors Few errors Some errors Frequent errors Comprehen Always Almost always Gist and main Isolated bits are sibility comprehen comprehensible ideas are comprehensible sible comprehensible Content Fully Adequately Partially Minimally coverage developed, developed, developed, developed, fully adequately partially supported minimally supported supported supported Vocabulary Range Broad Adequate Limited Very limited Variety Highly Varied; occasionally Lacks variety; Memorized; varied; non- repetitive repetitive highly repetitive repetitive 09/17/12 20
  • 21. Chocolate Chip Cookies Break into pairs. Compete the worksheet Creating a Rubric. Create a rubric for judging the quality of a chocolate chip cookie. -Be sure to decide if you want to do a holistic or analytic rubric!!!! Be prepared to defend your decision. Use the handout on Rubric Examples to help you when you get stuck! When you all finished, you will get to judge the cookies using the different rubrics. 09/17/12 See Lesson Builder Page 9 for 21 Handouts
  • 22. Using RubiStar These are some simple steps for getting started with Rubistar. Access the site http://rubistar.4teachers.org. Take a moment to read about the different features. When you are ready to get started, click on the tutorial and choose the option you prefer. 09/17/12 22
  • 23. Rubistar Tips If you are using Internet Explorer, you can copy the rubric and paste it into a Word document where you can continue to edit. When first getting started, you might want to choose an existing template. You may find that you can create a rubric you like by combining existing rubrics into one of your own. You can do this by opening two windows to Rubistar and copying and pasting between windows. 09/17/12 23
  • 24. Assignment Create a rubric for an objective/competency you have for a class you teach. Use the worksheet on creating a rubric to get you started. Divide into teams. Exchange rubrics and use the Aunt Olive's Rubric on Rubrics to provide feedback to a colleague on their work. 09/17/12 Lesson Builder Page 10 24
  • 25. Review 1. Describe a rubric (what is it). 2. Describe the purpose of rubrics. 3. Describe the difference between holistic and analytic rubrics. 4. List the characteristics of good rubrics. 5. Develop a rubric for judging the quality of a product (chocolate chip cookie). 6. Create/modify a rubric for an assignment or activity in a class you teach. 7. Identify strengths and weaknesses in a rubric. 09/17/12 25

Editor's Notes

  • #3: Page 4 LB, page 5 handout Explain how the printed handout works, where to find the materials in Blackboard, and slideshare.net/chedisky/slideshows Common rubrics are designed in a matrix. Many rubrics are designed as a matrix with Levels of performance across the columns (top) Criterion along the rows on the left.
  • #4: Page 4 LB, page 5 handout TLT--Teaching, Learning, Technology Group which manages the Flashlight Projects developed this http://www.tltgroup.org/resources/Flashlight/Rubrics.htm
  • #5: LB page 4, handout page 5 Jon Mueller http://jonathan.mueller.faculty.noctrl.edu/toolbox/rubrics.htm That is, a student's aptitude on a task is determined by matching the student's performance against a set of criteria to determine the degree to which the student's performance meets the criteria for the task. To measure student performance against a pre-determined set of criteria, a rubric, or scoring scale, is typically created which contains the essential criteria for the task and appropriate levels of performance for each criterion.
  • #6: Page 5 in LB, page 8 handout Well-designed rubrics increase an assessment's construct and content validity by aligning evaluation criteria to standards, curriculum, instruction, and assessment tasks. Well-designed rubrics increase an assessment's reliability by setting criteria that raters can apply consistently and objectively. Evaluating student work by established criteria reduces bias. Identifying the most salient criteria for evaluating a performance and writing descriptions of excellent performance can help teachers clarify goals and improve their teaching. Rubrics help learners set goals and assume responsibility for their learningthey know what comprises an optimal performance and can strive to achieve it. From: University of Minnesotas Virtual Assessment Center http://www.carla.umn.edu/assessment/VAC/Evaluation/p_5.html
  • #7: Page 5 in handout continued Rubrics used for self- and peer-assessment help learners develop their ability to judge quality in their own and others' work. Learners receive specific feedback about their areas of strength and weakness and about how to improve their performance. Learners can use rubrics to assess their own effort and performance, and make adjustments to work before submitting it for a grade.
  • #8: Page 5 Lesson Builder Rubrics allow learners, teachers, and other stakeholders to monitor progress over a period of instruction. Time spent evaluating performance and providing feedback can be reduced. When students participate in designing rubrics, they are empowered to become self-directed learners. Rubrics help teachers move away from subjective grading by allowing them and others, including students themselves, to assess work based on consistent, often agreed upon, and objective criteria.
  • #9: Page 6 in LB, page 11 handout
  • #10: Page 6 LB, handout page 11
  • #11: Page 6 LB, page 12 handout
  • #13: Page 6 LB, page 12 handout
  • #14: Page 15 handout, Briefly cover the steps. (do not refer to LB at this point)
  • #15: Page 15 handout Continue quick review of steps without reference to handout.
  • #16: Page 8 LB, page 16 handout
  • #17: Page 8 LB, page 17 handout
  • #18: Page 8 LB, page 17 handout
  • #19: Page 8 LB, page 17 handout
  • #21: Page 8 LB, page 18 handout
  • #22: Page 9 LB. Page 19 handout The handout includes the examples and form from the LB lesson. Students can open the pdf forms from LB to do this assignment. They can reference the handout if they want a hard copy. Be sure that they see that the form includes options for either holistic or analytic.
  • #23: Page 10 LB, page 30 handout
  • #24: Page 10 LB, page 30 handout
  • #25: Page 10 LB. Can access pdf from by clicking on Creating a Rubric
  • #26: Rewiew from page 12, page 33 handout (page 11 is resources)